Network Growth with Feedback 
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Existing models of network growth typically have one or two parameters or strategies which are 
fixed for all times. We introduce a general framework where feedback on the current state of a 
network is used to dynamically alter the values of such parameters. A specific model is analyzed 
where limited resources are shared amongst arriving nodes, all vying to connect close to the root. 
We show that tunable feedback leads to growth of larger, more efficient networks. Exact results 
show that linear scaling of resources with system size yields crossover to a trivial condensed state, 
which can be considerably delayed with sublinear scaling. 
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The prevalence and importance of network structures in 
physical, biological and social systems is becoming widely 
recognized. Current research on network growth focuses 
on models which reproduce aspects of real- world networks, 
in particular the broad range of node degrees typically ob- 
served [HIH [SHU [SUSIE]- These simple and elegant models 
have just one or two free parameters, or strategies which 
are specified initially and remain unaltered even as the 
network grows to a massive size, starting from a few seed 
nodes. Yet, the functionality and performance required 
of a small network may be radically different from that 
of a large network. Thus, it is natural that the param- 
eters of the growth strategy should change over time as 
the network grows. The mechanisms underlying these dis- 
tinct growth models can be generally classified as growth 
via either preferential attachment [lj|3j|4], copying [21 Ej, 
or optimization [5J[7]. In preferential attachment models, 
the extent of the preference (i.e., the connection kernel) 
could be altered, tuning properties of the resulting degree 
distribution [31 [5]. In copying models, the probability of 
successfully copying links could be changed, thus affecting 
degree distribution. In optimization models, the explicit 
parameter values of the optimization function could be al- 
tered, leading to a range of interesting behaviors [5J UJ [9] ■ 

In this rapid communication, we introduce a framework 
where information on the current state of a network pro- 
vides feedback to the system allowing it to dynamically 
alter and self-tune the parameter values throughout the 
growth process. It combines local optimization models of 
growth [71 [9] with measures of efficient information flow in 
a network [TO]. We show that with feedback, one can grow 
larger and more efficient network structures in less time. 
This framework can be applied to many systems exhibit- 
ing a hierarchical "chain of command" structure. Simple 
examples are business enterprises, armed forces, etc., with 
the "CEO" or the commander in chief respectively being 
the root node of the hierarchy. Such a structure has also 
recently been found in the organization of genetic regu- 
latory networks More generally, hierarchy appears 
to be a central organizing principle of complex networks, 
providing insight into structures such as food webs, bio- 
chemical and social networks [T^] . 

We are interested in growth of hierarchical networks 
where information flow is essential to the network's func- 



tion. Two basic considerations are: (i) ensuring a smooth 
"flow" of commands or information throughout the struc- 
ture, and, (ii) addition of new nodes subject to con- 
straints on resources. More explicitly, only some fraction, 
< c < 1 , of existing resources can be dedicated to opti- 
mizing new growth. The remaining portion of the system 
is involved with performing some task {e.g., information 
processing, regulation, transport and routing), crucial to 
the sustenance and function of the organization. We show 
herein that how the resources allocated for growth scale 
with system size N directly impacts the resulting net- 
work structure. Moreover, we show that incorporating 
feedback leads to flatter hierarchies on which information 
flows more efficiently, providing a quantitative underpin- 
ning to previous case studies of individual organizations 
where this is found in practice |13j . 

We consider a simple growth model incorporating (i) 
and (ii). It is a discrete time process starting from a sin- 
gle root node. Let G(t) denote the network at time t and 
N(t) the number of nodes. At each time-step, an integer 
number of new nodes, X(t) > 1, arrive and must con- 
nect to the existing network. In accord with (ii) , the frac- 
tion, < c < 1, of resources dedicated to optimizing new 
growth must be shared equally by all A(i) arriving nodes. 
Thus, each arriving node sees only k(t) — \c / X(t)][N (t)] a 
randomly chosen candidate parent nodes, where a deter- 
mines the scaling of resources and system size, e.g., a = 1 
is linear scaling. It then chooses the one candidate parent 
which is optimal in some sense (with degeneracy broken 
by a random choice) and connects to it. Even the simple 
criteria, that optimal is the candidate closest to the root 
node will demonstrate the importance of feedback. 

To elaborate on (i), the efficiency of information flow 
on G(t) quantifies the network fitness, T(G(t)), and is 
measured by the characteristic time-scale, t c , (see below 
and [IH]), for a weighted random walk on G(t). Other- 
measures exist, e.g., [13] . yet r c is used herein due to its 
simplicity. T{G{t)) is assessed every 5 time-steps. If it 
is found to increase, the system is rewarded by increased 
arrival rate A. If it decreases, the system is penalized by 
decreased A. Thus, starting from initial value Aq > 1, due 
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FIG. 1: (Color online) Data points are the expectation value, 
(t c (N)), of 1000 independent realizations with c = 1/3 and 
varying values of A as indicated. We find (t c (N)) ~ IniV' 3 
where /3 depends on c and A as shown in the inset. 
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A is thus a tunable parameter and our goal is to use feed- 
back to tune A during the growth process to build larger 
and more efficient structures. 

We capture a basic feedback loop (Fig. [3] (b), inset). 
For a given c, as A increases, c/A decreases, generating 
less efficient structures (i.e., bigger r c ) which will curtail 
the growth rate, and vice-versa. There is a direct anal- 
ogy to a business enterprise or an army, where an increase 
in the rate of employment leads to a smaller portion of 
resources given to optimizing the attachment of any indi- 
vidual new member. Thus, during rapid growth spurts, 
hiring is likely less optimal than during periods of slow 
growth. All techniques used herein are applicable to net- 
works, but for simplicity, we consider a tree where each 
arriving node connects to just one parent. 

The characteristic time, r c , is evaluated as in [10] where 
it was shown to be a performance metric for comparing al- 
ternate network topologies. Applications to sensor and to 
mobile network constructions are discussed in [T^l HE1 CZ] 
and a similar derivation of r c is in |18j . A random walk on 
G(t) is considered, where the walker represents a message 
to be communicated. We assume unicast communication 
(i.e., a node exchanges messages with only one other node 
at a time) and that all nodes constantly attempt to trans- 
mit messages. More specifically, if node i is connected to 
di neighbors, it successfully transmits on average 1/di frac- 
tion of the time, to one neighbor chosen at random (i.e., 
with probability 1/di). The remaining 1 — 1/di fraction 
of the time transmission is not successful and the message 
remains on node i, waiting to be transmitted. The state 
transition matrix P describes this process, where element 
Pij is the probability of the message passing from node i 
to j at any discrete time step, with Pa the probability of 
an unsuccessful attempt. = if i and j are not directly 



Pij = 



1/di 
1 - 1/di 



if i ^ j 
if i = j. 
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P is column stochastic and irreducible. Let and Vi 
denote the eigenvalues and eigenvectors of P. By the 
Perron- Frobenius theorem, there is one eigenvalue r\ — 1 
corresponding to the unique steady-state distribution. All 
remaining eigenvalues have |r.;| < 1 and are modes that 
decay to the steady-state. The characteristic time r, for 
mode i to decay by a factor of 1 /e is defined by the equal- 
ity P Ti Vi — (ri) Ti Vi and setting \ri\ Ti = 1/e. The longest 
characteristic time r c results from (the largest < 1). 
Rearranging, t c = — 1/ln |r 2 |. 

To implement Eqn. ([!]) we need to compare T(G) for two 
networks with different sizes. Yet as N increases, t c typ- 
ically increases. No rigorous results exist describing the 
relationship. We find empirically that (t c (N)) ~ In TV 3 , 
where (3 depends on c and A, as shown in Fig. [I] Fit- 
ness of any particular realization is thus evaluated as 
T(G) = — Tc/hiN 13 (relative to the ensemble of networks 
with those specific values of c, A and N). Note, the nega- 
tive sign is due to larger r c being less fit. 

We analyze the model above via computer simula- 
tion, implementing it in R and visualizing results with 
Graphviz [19 . First we consider no feedback (A constant) 
and linear scaling of k(t) = \cN(t)/X~\. The notation \a\ 
denotes the closest integer greater than or equal to a, used 
since k, the number of candidate parents, must be an in- 
teger. Linear scaling provides intuition on how c/A tunes 
the structures. There are two limiting behaviors: c/A = 1 
(i.e., k — N) generates a star topology; and c/A — * 
(i.e., k = 1) generates exactly random recursive trees |20j . 
Figure [2] shows representative networks grown with three 
different fixed values of c/A, with maximum node degree 
dM and maximum depth Km indicated. 

On incorporating feedback (Eqn. (JT|) with S finite), A be- 
comes a tunable parameter. For fixed c, as A increases the 
system moves towards k = 1 (adding new layers of hier- 
archy). As A decreases the system moves towards k = TV 
(filling in existing levels of the hierarchy). Thus adjust- 
ments in A tune the levels of hierarchy (and the degree 
assortativity [2Tj). Figure [3] (a) shows a typical network 
grown with feedback where c = 1/3, Ao = 1 and 6 = 2, 
grown to size N = 200. It has the same initial conditions 
and final size as Fig. [2] (b), however, with dM = 17 it re- 
sembles a more balanced version of Fig. |](c). Also, the 
root is no longer the highest degree node. Figure [3] (b) 
shows the evolution of X(t) for this realization which is 
representative of the typical behavior observed (in particu- 
lar, the final steady-state oscillation). For larger networks, 
the consequences of linear scaling between k(t) and N(t) 
become manifest even in the absence of feedback. With 
no feedback, using k(t) = \ cN (t) / X(t)~\ quickly leads to 
a "condensed" structure where all new nodes join with 
depth h < 2. Much of the analysis in [5] applies here, 
except now k{t) is a function rather than a fixed con- 
stant. Let Qj(t) denote the number of nodes at depth 
j, and Hj(t) the expected number of nodes at depth j 



FIG. 2: (Color online) With no feedback networks range from 
stars (a) to random recursive trees. Example of networks with 
(a) § = 1, N = 16; (b) f = 1/3, N = 200; (c) § = 1/10, 
N = 200, with maximum degree du and depth hu indicated. 



FIG. 3: (Color online) (a) A typical network grown with feed- 
back. Here c = 1/3, A = 1, N = 200, and 8 = 2. This network 
interpolates dynamically between those in Fig. [2] (b) A(£) for 
this realization. Inset : schematic of feedback loop. 



in the candidate set, fij{t) — k(t)Qj(t)/N(t). Boundary 
conditions are Qo(t) = 1 for all t > 0, and Qj{0) = 
for all j > 1. We can explicitly calculate the exact re- 
currence Qi(t) — Xm=iM n )/ n - Approximating the dis- 
crete sum by integration, for k(t) = cN(t)/X, we find 
Qt(t) w cN(t)/X and accordingly, ^i(t) = (c/\) 2 N(t). 
Thus once iV(£) > N x = (A/c) 2 , > 1, and with high 

probability all further incoming nodes join with h < 2. 
Figure [1] (a) shows this crossover of the depth distribution 
for fixed c/A = 0.02 (with crossover length N x = 2500). 

For sublinear scaling, such as kit) = \c-J N(t)/\(t)~\ , 
condensation to h < 2 can be avoided. Q±(t) « 2c^/~N /A, 
and thus \i\ — 2(c/A) 2 < 1 so long as c/A < l/v2 (in- 
dependent of N). Yet, we eventually see condensation 
to depth h < 3 happen once Q2(t) grows large. Asymp- 
totically Q 2 (t) = J [k(n)Qi(n)/n]dn m 2c 2 TV/A 2 . Once 
/i 2 (i) = 2c 3 7V 1 / 2 /A 3 > 1, all subsequent nodes join with 
h < 3, which occurs at crossover length N x — 0.25(A/c) 6 . 
Figure [1] (b) shows the evolution of the depth distribu- 
tion for N < N x with c/A = 0.02 (here N x = 4 x 10 9 ). 
It becomes more sharply peaked with increasing N and 
shifts towards lower average depth but remains concen- 
trated well above the final condensed state. In general 
we can show that k ~ TV 1 /", for a any integer, ultimately 
leads to condensation at depths h < a+ 1, with crossover 
as large as N x ~ (A/c) a ' a+1 - ) [25]. For logarithmic scal- 
ing, (k(t) = fclog(JV(t))/A(t)l), the peak of the depth 
distribution increases as j = In AT/ In In iV, and collapse is 
avoided altogether [2"2"] . 

Now that the dependence between k(t) and N is un- 
derstood in the absence of feedback, we can incorporate 
feedback. We are interested in realistic values of c ~ 1/3 
and netwo rks of N ~ 1000 for which square-root scaling, 
k(t) = \c v / N(t)/X(t)~\ , is sufficient to avoid crossover. We 
numerically generate ensembles of 100 independent real- 
izations at various values of c and Ao , all of which produce 
similar results. Table |T] summarizes numerical results for 
c = 1/3 and A = 3 (here N x - 10 5 ). Column 2 is the 
baseline behavior with no feedback. Comparing this with 
columns 3 and 5 shows that feedback leads to more efficient 
networks grown to the same size (N = 501) in less time, 
with greater depth and lower maximum degree. Compar- 
ing column 2 with 4 and 6 shows that in a given time in- 



terval, with feedback, networks grow about twice as large 
and have improved efficiency. In general we find these de- 
sirable outcomes are enhanced the more often feedback is 
evaluated. The time required to attain TV = 501 decreases 
linearly with decreasing S and the network size attained 
in an allotted time interval increases linearly with decreas- 
ing 5. Of course, each time feedback is assessed requires 
resources. In our numerical implementation, they are com- 
putational resources. Determining the optimal value of S 
would require assessing the tradeoff between this increase 
in resources and the enhanced network properties. For 
(5 S 10, our simulations do not show significant sample- 
to-sample fluctuations in {T{Q)). An exhaustive study of 
self- averaging in networks [23] with feedback may be dis- 
cussed elsewhere [22 . In summary, we introduce a gen- 
eral framework for incorporating feedback into network 
growth models. Proof of concept is demonstrated using a 
simple model of a hierarchical network where limited re- 
sources are shared amongst all arriving nodes, vying to 
minimize their distance to the root. Feedback leads to 
growth of larger, more efficient structures. Linear scal- 
ing of resources results in crossover to a trivial condensed 
structure which can be considerably delayed with sublin- 
ear scaling. In the context of a growing organization, this 
suggests sublinear scaling is necessary once N ~ 1000. It 
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FIG. 4: (Color online) Depth distribution for c/A = 0.02. (a) 
Linear scaling, k ~ N, results in condensation to h < 2 for 
N > N x = (A/c) 2 . (b) For k ~ y/N , the distribution remains 
concentrated well above the condensed structure for N <§C N x = 
0.25(A/c) 6 . 
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< Tc/lnN 13 > 
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0.014 ±0.001 


0.016 ±0.001 



TABLE I: Average network properties, over 100 independent realizations, for c = 1/3, Ao = 3, and k(t) = \c^/ N(t)/ X(t)~\ . 
Comparing columns 2, 3, and 5 shows that with feedback networks grow to be of size N = 501 in much shorter time and are more 
efficient (smaller r c / In N 13 ). They also have greater maximum depth and lower maximum degree. Comparing columns 2, 4 and 
6 shows that in a given time interval, networks with feedback grow to be to about twice the size and are more efficient. 



may be possible to obtain rigorous results for this model 
of network growth with feedback by interpreting c/A as a 
branching rate or by proving convergence of X(t) to steady- 
state oscillation. 

The general framework proposed herein allows flexibility 
in choosing other growth models, communication models 
between nodes P,j (e.g., broadcast rather than unicast), 
and fitness functions T(G(t)) (e.g., fitness landscapes [53] 
modeling random evolutionary pressures). Such alternate 
choices of !F(G(t)) may overcome the current limitation 
that global topology information is required to assess t c . 
An alternate growth model, where nodes maximize their 



distance to the root, also seems to demonstrate similar 
effects of feedback 

Other recent models that could provide mechanisms for 
introducing feedback are the TARL model of two interact- 
ing networks [25] , a generative model where loops within a 
network are considered as potential feedback channels [26 , 
and the layered network framework of |27j . 

Discussions with C. D'Souza, J. Chayes, C. Borgs, P. 
Krapivsky, J. Machta and C. Moore, and attendance at 
MSPJ's "Real World Data Networks" and IPAM's "Ran- 
dom Shapes" workshops are gratefully acknowledged. 
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